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Background  and  Motivations 


•  Spectral  analysis  is  a  popular  mathematical  tool  in 
analyzing  network  and  distributed  systems 

•  Given  such  a  system  (e.g.,  a  sensor-target  measurement 
system)  it's  often  sufficient  to  examine  only  those 
dominating  eigenvectors  for  which  the  corresponding 
eigenvalues  are  much  larger  than  the  rest  of  eigenvalues 

•  That  is,  these  dominating  eigenvectors  can  reveal 
important  properties/states  of  the  underlying  system  (e.g. 
detecting  a  malfunctioning  sensor) 


Objective  of  This  Work 


We  want  to  characterize 
graphs  which  exhibit  strong 
dominance  of  the  leading 
eigenvalues 

It  is  difficult  to  provide  such 
characterization  for  general 
graphs,  so  we  focus  on  some 
special  graphs,  which  we  call 
“cluster  ensembles,”  as 
depicted  to  the  right 

Cluster  ensembles  arise 
naturally  when  we  construct  a 
hierarchical  system  by 
interconnecting  clusters 


Cluster  Ensemble 


I  Cluster  | 

Interconnection  Network  I 


A  Cluster  Ensemble  Example: 
Three  Clusters  Connected  Via  a  Clique 


Cluster  Interconnection  Network 


(A  More  Readable  Redrawing) 

Cluster  nodes  which  are  part  of  the 
cluster  interconnection  network  are 
called  hub  nodes.  Thus,  nodes  10, 
11  and  12  are  hub  nodes 
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Furthermore,  We  May  In  Addition  Assume 
Alpha-Beta  Cluster  Ensemble 


This  is  a  special  cluster  ensemble  satisfying  the  following 
properties: 

1 .  There  are  a  identical  clusters 

2.  Each  cluster  contains  one  hub  node  and  (3  non-hub 
nodes.  This  means  that  the  size  of  each  cluster  is 

(3  +  1. 

3.  In  the  adjacency  matrix  C  of  each  cluster,  columns  of 
non-hub  nodes  are  orthogonal  to  each  other 

It  is  possible  to  relax  the  above  assumptions,  e.g.,  for  the 
orthogonality  condition  of  item  3,  CTC  can  go  from  a  diagonal 
matrix  to  a  diagonally  dominant  one 


An  Instance  of  an  Alpha-beta  Cluster 
Ensemble  with  a  =  3  and  p  =  3 
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Notation  for  Eigenvalues 


•  In  what  follows,  the  eigenvalues  of  a  symmetric  matrix  are 
always  ordered  such  that 

A,  <  < ...  < 

•  When  it  is  useful  to  indicate  that  they  are  the  eigenvalues 
on  a  specific  matrix  F,  we  write  instead 


\(F)<A 2(F)<...<\(F) 


Preview  of  an  Exemplar  Result 


Consider  an  alpha-beta  cluster 
ensemble  of  a  identical  clusters 
interconnected  under  a  clique 
topology 

Each  cluster  contains  (B  non-hub 
nodes 

Let  m  =  a  (p  +  1 )  be  the  total  number 
of  nodes  in  the  ensemble,  and  p  the 
largest  in-degree  of  a  non-hub  node 

Let  A  be  the  adjacency  matrix  of  the 
entire  ensemble 


Exemplar  Theorem: 


A 


m-a+l 


(Jj)  >  l 


A(AtA)  m 


An  instance  of  an  alpha-beta 
cluster  ensemble 
with  a  =  3  and  |3  =  3 


V. 
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Implication  of 
The  Exemplar  Theorem 


Exemplar  Theorem: 


>  p 

v _  J 


•  As  p  increases,  the  separation 
ratio  of  the  a  leading 
eigenvalues  from  the  rest  of 
non-zero  eigenvalues 
increase  by  a  factor  of  at  least 
3/p.  Thus  when  p  is  large, 
:here  are  a  dominating  leading 
eigenvalues 

•  Thus  we  have  succeeded  in 
relating  the  dominance  of  the 
leading  eigenvalues  to  cluster 
size  p 


Cluster  size  =  p 


a  clusters  vvo 


-  8 
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Steps  in  Establishing  Results  of  This  Paper 


1 .  Consider  a  general  m-node,  /c-cluster  ensemble 

2.  Partition  the  adjacency  matrix  A  of  the  cluster  ensemble 
and  introduce  the  cluster  interconnection  submatrix  B 

3.  Derive  bounds  for  the  eigenvalues  of  ATA  in  terms  of 
those  of  B 

4.  Consider  the  special  case  of  alpha-beta  cluster 
ensembles,  and  derive  bounds  for  the  eigenvalues  of  B  in 
terms  of  a  and  (3 

5.  Derive  bounds  on  the  separation  ratio  for  the  a  leading 
eigenvalues  of  an  alpha-beta  cluster  ensemble,  including 
bounds  in  the  Exemplar  Theorem  described  earlier 


We  will  describe  these  steps  in  the  rest  of  this  presentation 
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Partitioning  ATA  and 
Cluster  Interconnection  Submatrix 


•  For  a  general  m-node,  /c-cluster 
ensemble,  we  can  assume 
without  loss  of  generality  that  its 
adjacency  matrix  A  has  the  last 
k  columns  corresponding  to  the 
k  hub  nodes 


•  We  express  ATA  in  a  partitioned 
form: 


The  B  submatrix  reflects 
the  interconnections 
among  the  hub  nodes  and 
those  between  the  hub 
nodes  and  other  nodes  in 
their  respective  clusters. 
We  call  B  the  cluster 
interconnection  submatrix 

Our  Theorem  on  the  next 
slide  shows  that 
eigenvalues  of  B  can 
contribute  to  upper  and 
lower  bounds  for  those  of 
ATA 
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A  Theorem  Based  on 
Cauchy’s  and  Aronszajn's  inequalities 


m 


ata  = 


T  X 
XT  B 

k 


i 

\ 


J 


m 


Theorem  (Eigenvalue  bounds  for  ATA): 

Aj-(AT  A)  <  Xj{T)  <  \+j(AT A) 

for  j  =  1 ,  . . . ,  m-k,  and 

<  Xm_,{ATA)  <  +  Z„_t(T) 

Vfory=0 . /c — 1 _ 
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Lower  Bound  on  Eigenvalue  Separation  Ratio 


Corollary  (Bound  on  eigenvalue  separation  ratio): 

Xm_M{ATA)^  MB) 

Am_k(ATA)  Am_k(T) 


T 


Cluster  Interconnection  Networks 
for  Alpha-Beta  Cluster  Ensembles 


We  consider  the  two  extreme  topologies  for  the 
cluster  interconnection  network:  clique  (most  dense) 
and  ring  (most  sparse) 


(a)  Clique  (b)  Ring 
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For  the  Case  of  Alpha-Beta  Cluster  Ensemble 


Instead  of: 

A1  A 


we  have: 


f 


m 

JL 


1 


where  D  is  diagonal 
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Eigenvalues  for  the  Cluster 
Interconnection  Submatrix  B 


Consider  the  cluster  interconnection 
network  of  an  alpha-beta  cluster  ensemble 


Theorem: 


(a)  If  the  hub  interconnection  is  a  clique,  then 

A j(B)  =  p  for j  =  1 

K a(B)  =  a2  +  P 

(b)  If  the  hub  interconnection  is  a  ring,  then 


P  <  AAB)  <  P+A  fory  =  1, 

t/ 


Note:  Theorem  holds  without  the  orthogonality  assumption  for  non-hub 
columns  in  each  cluster’s  adjacency  matrix 


Bounds  on  Eigenvalue 
Separation  Ratios  for  AM 


Consider  an  alpha-beta  cluster  ensemble. 
Suppose  the  cluster  interconnection  network  is  a 
clique  or  ring.  We  note:  m  =  a  ((3  +  1 )  and  k  =  a 
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System  Implications 


•  When  p  increases,  the 
separation  ratio  of  the  a 
leading  eigenvalues  and 
the  rest  of  non-zero 
eigenvalues  will  increase 
by  a  factor  of  at  least  p/p 

•  There  are  no  significant 
separations  among  the  a 
leading  eigenvalues 
themselves 

•  This  means  the  a  leading 
eigenvectors  will  largely 
characterize  the  system 


Cluster  size  =  p 


a  clusters  yV\> 


9 
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Summary  and  Conclusion 


•  We  have  motivated  the  problem  of  characterizing  systems 
which  exhibit  strong  dominance  of  the  leading 
eigenvalues,  in  terms  of  underlying  network  topologies 

•  We  have  introduced  a  special  class  of  networks  called 
cluster  ensembles,  and  established  some  fundamental 
mathematical  results  of  ensuring  such  dominance 

•  As  future  work,  we  plan  to  generalize  these 
characterization  by  allowing  more  general  topologies  than 
the  alpha-beta  ensemble  and  develop  applications  in 
system  design  based  on  spectral  properties  established 
in  this  paper 
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